Conducting a private videoconference within a videoconference via an MCU

ABSTRACT

Conducting a private videoconference within a videoconference. A videoconference may be established between a plurality of endpoints. Input may be received requesting the private videoconference for a plural subset of the plurality of endpoints. The private videoconference may be established between the plural subset of the plurality of endpoints. The initial videoconference may continue during the private videoconference. Private videoconference data may be transmitted only to the plural subset of endpoints of the private videoconference. The private videoconference may be sent directly between the plural subset of endpoints or may be sent via a multipoint control unit, e.g., of the initial videoconference. The private videoconference data may not be sent to the remaining endpoints of the initial videoconference.

FIELD OF THE INVENTION

The present invention relates generally to conferencing and, morespecifically, to conducting a private videoconference within avideoconference.

DESCRIPTION OF THE RELATED ART

Videoconferencing may be used to allow two or more participants atremote locations to communicate using both video and audio. Eachparticipant location may include a videoconferencing system forvideo/audio communication with other participants. Eachvideoconferencing system may include a camera and microphone to collectvideo and audio from a first or local participant to send to one or moreother (remote) participants (optionally through an MCU). Eachvideoconferencing system may also include a display and speaker toreproduce video and audio received from remote participant(s). Eachvideoconferencing system may also be coupled to a computer system toallow additional functionality into the videoconference. For example,additional functionality may include data conferencing (includingdisplaying and/or modifying a document for both participants during theconference).

In some cases, during a videoconference, some of the participants maywish to discuss a topic between themselves, e.g., privately. Usingcurrent videoconferencing systems, such participants might have toresort to offline methods, such as email, chat, or cell phones.Accordingly, improvements in videoconferencing are desired.

SUMMARY OF THE INVENTION

Various embodiments are presented of a system and method for conductinga private videoconference within a first videoconference.

A multipoint control unit (MCU) may initially perform the first (ormain) videoconference between a plurality of videoconference endpoints.For example, the MCU may perform decoding and encoding operations onvideo information transmitted in the first videoconference between theplurality of videoconferencing endpoints.

Input may be received, during the first videoconference, which requeststhe private videoconference for a plural subset of the plurality ofvideoconference endpoints. The plural subset is not the entirety of theplurality of videoconference endpoints in the videoconference (i.e., isnot all of the endpoints in the videoconference). In some embodiments,the input may be received from a first endpoint of the firstvideoconference (e.g., from a user via a graphical user interface (GUI)of the first endpoint).

Correspondingly, the private videoconference may be initiated betweenthe plural subset of the plurality of videoconference endpoints.However, the initiation (and subsequent performance) of the privatevideoconference does not end the first videoconference.

During the private videoconference, the MCU may transmit videoconferenceinformation between ones of the plural subset of endpoints to conductthe private videoconference. For example, the MCU may transmit firstvideoconference information from the first videoconference endpoint ofthe plural subset to one or more second videoconference endpoints of theplural subset to conduct the private videoconference. In someembodiments, the MCU may not encode and decode the first videoconferenceinformation.

Additionally, during the private videoconference, the MCU may transmitvideoconference information among the remaining subset of endpoints toconduct the first (main) videoconference. In other words, the mainvideoconference continues for those participants who are not part of theprivate videoconference. For example, the MCU may transmit secondvideoconference information from one of the remaining subset ofendpoints to one or more other videoconference endpoints of theremaining subset to conduct the first videoconference. The MCU mayencode and decode the second videoconference information. However, thefirst videoconference information of the plural subset (the privatevideoconference) is not transmitted to the remaining subset (the mainvideoconference). In one embodiment, the second videoconferenceinformation of the remaining subset (the main videoconference) is nottransmitted to the plural subset (the private videoconference). However,in alternate embodiments, the MCU may also transmit the secondvideoconference information (the content of the main videoconference) tothe plural subset (i.e., to the participants of the privatevideoconference). Thus, in this embodiment the participants of theprivate videoconference see each other as well as content of the mainvideoconference, but of course the participants of the mainvideoconference do not see the content of the private videoconference.In one embodiment, the plural subset of endpoints (the privatevideoconference participants) see the videoconferencing information ofthe main videoconference in a portion of their display, so that they canbe assured that their private videoconference is in fact private.

In some embodiments, the remaining subset of videoconferencing endpointsmay display text or a static image for at least one of the plural subsetof videoconferencing endpoints during the private videoconference. Morespecifically, one or more portions of the display which were previouslydedicated to participants which are now in the private videoconferencemay have the text or static images displayed. For example, the text“private” or a static image of the participant or participant location(or other image) may be displayed in the corresponding portion of thedisplay.

The private videoconference may be ended between the plural subset ofthe plurality of endpoints. Correspondingly, the plural subset ofendpoints may be rejoined with the remaining subset in the firstvideoconference.

BRIEF DESCRIPTION OF THE DRAWINGS

A better understanding of the present invention may be obtained when thefollowing detailed description is considered in conjunction with thefollowing drawings, in which:

FIGS. 1 and 2 illustrate exemplary videoconferencing system participantlocations, according to an embodiment;

FIGS. 3A and 3B illustrate exemplary conferencing systems coupled indifferent configurations, according to some embodiments;

FIGS. 4A and 4B are flowchart diagrams illustrating embodiments of amethod for conducting a private videoconference within a firstvideoconference;

FIGS. 5A and 5B are exemplary block diagrams illustrating potentiallayouts for members of a first videoconference, according to oneembodiment;

FIG. 6 illustrates the flow of information in a request for a privatevideoconference, according to one embodiment;

FIG. 7 is an exemplary block diagram illustrating potential layouts formembers of a private videoconference and a first videoconference;

FIG. 8 illustrates the flow of information during a privatevideoconference according to the embodiment of FIG. 4A; and

FIG. 9 illustrates the flow of information during a privatevideoconference according to the embodiment of FIG. 4B.

While the invention is susceptible to various modifications andalternative forms, specific embodiments thereof are shown by way ofexample in the drawings and will herein be described in detail. Itshould be understood, however, that the drawings and detaileddescription thereto are not intended to limit the invention to theparticular form disclosed, but on the contrary, the intention is tocover all modifications, equivalents, and alternatives falling withinthe spirit and scope of the present invention as defined by the appendedclaims. Note the headings are for organizational purposes only and arenot meant to be used to limit or interpret the description or claims.Furthermore, note that the word “may” is used throughout thisapplication in a permissive sense (i.e., having the potential to, beingable to), not a mandatory sense (i.e., must). The term “include”, andderivations thereof, mean “including, but not limited to”. The term“coupled” means “directly or indirectly connected”.

DETAILED DESCRIPTION OF THE EMBODIMENTS Incorporation by Reference

U.S. patent application titled “Video Conferencing System Transcoder”,Ser. No. 11/252,238, which was filed Oct. 17, 2005, whose inventors areMichael L. Kenoyer and Michael V. Jenkins, is hereby incorporated byreference in its entirety as though fully and completely set forthherein.

Terms

The following is a glossary of terms used in the present application:

Memory Medium—Any of various types of memory devices or storage devices.The term “memory medium” is intended to include an installation medium,e.g., a CD-ROM, floppy disks, or tape device; a computer system memoryor random access memory such as DRAM, DDR RAM, SRAM, EDO RAM, RambusRAM, etc.; or a non-volatile memory such as a magnetic media, e.g., ahard drive, or optical storage. The memory medium may comprise othertypes of memory as well, or combinations thereof. In addition, thememory medium may be located in a first computer in which the programsare executed, or may be located in a second different computer whichconnects to the first computer over a network, such as the Internet. Inthe latter instance, the second computer may provide programinstructions to the first computer for execution. The term “memorymedium” may include two or more memory mediums which may reside indifferent locations, e.g., in different computers that are connectedover a network.

Carrier Medium—a memory medium as described above, as well as a physicaltransmission medium, such as a bus, network, and/or other physicaltransmission medium that conveys signals such as electrical,electromagnetic, or digital signals.

Computer System—any of various types of computing or processing systems,including a personal computer system (PC), mainframe computer system,workstation, network appliance, Internet appliance, personal digitalassistant (PDA), television system, grid computing system, or otherdevice or combinations of devices. In general, the term “computersystem” can be broadly defined to encompass any device (or combinationof devices) having at least one processor that executes instructionsfrom a memory medium.

FIGS. 1 and 2—Exemplary Participant Locations

FIG. 1 illustrates an exemplary embodiment of a videoconferencingparticipant location, also referred to as a videoconferencing endpointor videoconferencing system (or videoconferencing unit). Thevideoconferencing system 103 may have a system codec 109 to manage botha speakerphone 105/107 and videoconferencing hardware, e.g., camera 104,display 101, speakers 171, 173, 175, etc. The speakerphones 105/107 andother videoconferencing system components may be coupled to the codec109 and may receive audio and/or video signals from the system codec109.

In some embodiments, the participant location may include camera 104(e.g., an HD camera) for acquiring images (e.g., of participant 114) ofthe participant location. Other cameras are also contemplated. Theparticipant location may also include display 101 (e.g., an HDTVdisplay). Images acquired by the camera 104 may be displayed locally onthe display 101 and/or may be encoded and transmitted to otherparticipant locations in the videoconference.

The participant location may further include one or more input devices,such as the computer keyboard 140. In some embodiments, the one or moreinput devices may be used for the videoconferencing system 103 and/ormay be used for one or more other computer systems at the participantlocation, as desired.

The participant location may also include a sound system 161. The soundsystem 161 may include multiple speakers including left speakers 171,center speaker 173, and right speakers 175. Other numbers of speakersand other speaker configurations may also be used. The videoconferencingsystem 103 may also use one or more speakerphones 105/107 which may bedaisy chained together.

In some embodiments, the videoconferencing system components (e.g., thecamera 104, display 101, sound system 161, and speakerphones 105/107)may be coupled to a system codec 109. The system codec 109 may be placedon a desk or on a floor. Other placements are also contemplated. Thesystem codec 109 may receive audio and/or video data from a network,such as a LAN (local area network) or the Internet. The system codec 109may send the audio to the speakerphone 105/107 and/or sound system 161and the video to the display 101. The received video may be HD videothat is displayed on the HD display. The system codec 109 may alsoreceive video data from the camera 104 and audio data from thespeakerphones 105/107 and transmit the video and/or audio data over thenetwork to another conferencing system. The conferencing system may becontrolled by a participant or user through the user input components(e.g., buttons) on the speakerphones 105/107 and/or input devices suchas the keyboard 140 and/or the remote control 150. Other systeminterfaces may also be used.

In various embodiments, a codec may implement a real time transmissionprotocol. In some embodiments, a codec (which may be short for“compressor/decompressor”) may comprise any system and/or method forencoding and/or decoding (e.g., compressing and decompressing) data(e.g., audio and/or video data). For example, communication applicationsmay use codecs for encoding video and audio for transmission acrossnetworks, including compression and packetization. Codecs may also beused to convert an analog signal to a digital signal for transmittingover various digital networks (e.g., network, PSTN, the Internet, etc.)and to convert a received digital signal to an analog signal. In variousembodiments, codecs may be implemented in software, hardware, or acombination of both. Some codecs for computer video and/or audio mayinclude MPEG, Indeo™, and Cinepak™, among others.

In some embodiments, the videoconferencing system 103 may be designed tooperate with normal display or high definition (HD) displaycapabilities. The videoconferencing system 103 may operate with networkinfrastructures that support T1 capabilities or less, e.g., 1.5mega-bits per second or less in one embodiment, and 2 mega-bits persecond in other embodiments.

Note that the videoconferencing system(s) described herein may bededicated videoconferencing systems (i.e., whose purpose is to providevideoconferencing) or general purpose computers (e.g., IBM-compatiblePC, Mac, etc.) executing videoconferencing software (e.g., a generalpurpose computer for using user applications, one of which performsvideoconferencing). A dedicated videoconferencing system may be designedspecifically for videoconferencing, and is not used as a general purposecomputing platform; for example, the dedicated videoconferencing systemmay execute an operating system which may be typically streamlined (or“locked down”) to run one or more applications to providevideoconferencing, e.g., for a conference room of a company. In otherembodiments, the videoconferencing system may be a general use computer(e.g., a typical computer system which may be used by the general publicor a high end computer system used by corporations) which can execute aplurality of third party applications, one of which providesvideoconferencing capabilities. Videoconferencing systems may be complex(such as the videoconferencing system shown in FIG. 1) or simple (e.g.,a user computer system 200 with a video camera, input devices,microphone and/or speakers such as the videoconferencing system of FIG.2). Thus, references to videoconferencing systems, endpoints, etc.herein may refer to general computer systems which executevideoconferencing applications or dedicated videoconferencing systems.Note further that references to the videoconferencing systems performingactions may refer to the videoconferencing application(s) executed bythe videoconferencing systems performing the actions (i.e., beingexecuted to perform the actions).

The videoconferencing system 103 may execute various videoconferencingapplication software that presents a graphical user interface (GUI) onthe display 101. The GUI may be used to present an address book, contactlist, list of previous callees (call list) and/or other informationindicating other videoconferencing systems that the user may desire tocall to conduct a videoconference.

Note that the videoconferencing system shown in FIGS. 1 and 2 may bemodified to be an audioconferencing system. For example, the conferencemay be a teleconference, where at least a subset or all of theparticipants are called using telephone numbers. Alternatively, theaudioconference could be performed over a network, e.g., the Internet,using VOIP. The audioconferencing system, for example, may simplyinclude speakerphones 105/107, although additional components may alsobe present. Additionally, note that any reference to a “conferencingsystem” or “conferencing systems” may refer to videoconferencing systemsor audioconferencing systems (e.g., teleconferencing systems). In theembodiments described below, the conference is described as avideoconference, but note that the methods may be modified forutilization in an audioconference.

FIGS. 3A and 3B—Coupled Conferencing Systems

FIGS. 3A and 3B illustrate different configurations of conferencingsystems. The conferencing systems may be operable to perform the methodsdescribed herein. As shown in FIG. 3A, conferencing systems (CUs) 320A-D(e.g., videoconferencing systems 103 described above) may be connectedvia network 350 (e.g., a wide area network such as the Internet) and CU320C and 320D may be coupled over a local area network (LAN) 375. Thenetworks may be any type of network (e.g., wired or wireless) asdesired.

FIG. 3B illustrates a relationship view of conferencing systems310A-310M. As shown, conferencing system 310A may be aware of CU310B-310D, each of which may be aware of further CU's (310E-310G,310H-310J, and 310K-310M respectively). CU 310A may be operable toperform the methods described herein. In a similar manner, each of theother CUs shown in FIG. 3B, such as CU 310H, may be able to perform themethods described herein, as described in more detail below. Similarremarks apply to CUs 320A-D in FIG. 3A.

Private Videoconferences

In a first embodiment, the private videoconference is facilitated by themultipoint control unit (MCU) that hosts the main videoconference. In asecond embodiment, the private videoconference is implemented withdirect transmission among the private participant endpoints, without useof the MCU that hosts the main videoconference.

FIGS. 4A—Private Videoconference Using an MCU

FIG. 4A illustrates a method for performing a private videoconferencewithin a first (or main) videoconference using an MCU. The method shownin FIG. 4 may be used in conjunction with any of the computer systems ordevices shown in the above Figures, among other devices. In variousembodiments, some of the method elements shown may be performedconcurrently, performed in a different order than shown, or omitted.Additional method elements may also be performed as desired. As shown,this method may operate as follows.

In 402, a videoconference may be initiated or performed between aplurality of participants at respective participant locations. Morespecifically, the videoconference may be initiated between a firstparticipant using a first endpoint (e.g., at a first participantlocation) and a plurality of other participants using other endpoints(e.g., at other participant locations). Thus, endpoints may be similarto those described above regarding FIGS. 1 and 2, although othervariations are envisioned. The videoconference may be establishedaccording to any of a variety of methods, e.g., the one described inpatent application Ser. No. 11/252,238, which was incorporated byreference above. The videoconference may utilize an instant messagingservice or videoconferencing service over the Internet, as desired.

In some embodiments, a multipoint control unit (MCU) may perform thefirst videoconference between the plurality of videoconferenceendpoints. For example, the MCU may perform decoding and encodingoperations on video information transmitted in the first videoconferencebetween the plurality of videoconferencing endpoints.

FIG. 5A illustrates exemplary screen layouts for four participants of avideoconference. As shown, the videoconference of FIG. 5A includes fourparticipants, Mike, Alice, Jane, and Joe. Each corresponding screen ofFIG. 5A illustrates a four quadrant layout where each participant isable to see the other participants and himself, or potentially auxiliaryvideo (e.g., of his computer screen, a presentation, etc.). FIG. 5Billustrates a different display layout for Alice, where Jane is giventhe majority of the screen and the other participants are shown smaller(e.g., including herself). This layout may be used so that activetalkers (in this case Jane) may be preferentially given more of thedisplay screen. Note that the participants may be able to select eitherlayout, or another layout, as desired.

In 404, input may be received, during the first videoconference, whichrequests a private videoconference for a plural subset of the pluralityof videoconference endpoints. The plural subset is not the entirety ofthe plurality of videoconference endpoints in the videoconference. Insome embodiments, the input may be received from a first endpoint of thefirst videoconference (e.g., from a user via a graphical user interface(GUI) of the first endpoint). For example, the first participant at thefirst participant location may use a remote (e.g., a far end button onthe remote) to request a private videoconference with a secondparticipant of the first videoconference. Alternatively, the firstparticipant may request the private videoconference in other ways, e.g.,using a mobile device, a computer system, etc. The other potentialparticipant(s) of the private videoconference may see a message on theirdisplay indicating the request for the private videoconference. Therequest may indicate the participant who requested the privatevideoconference, as well as the other participants, if any, to whom therequest was made. The other potential participant(s) of the privatevideoconference may be able to accept the invitation, e.g., using theirremotes, or other methods.

FIG. 6 illustrates an exemplary diagram of a videoconference wherecommunication is transmitted from participants B, C, and D, toparticipant A, who is the organizer. In this embodiment, the endpoint ofparticipant A may perform MCU functionality for the videoconference. Asshown, participant B may wish for a private meeting or videoconferencewith participant C. In this example, participant B may provide input totheir endpoint, which may in turn provide signals indicating such arequest to the MCU, e.g., in this example the endpoint for participantA, which is acting as the MCU. The MCU may then forward the request tothe endpoint of participant C. Participant C may then provide inputaccepting the private videoconference.

Correspondingly, in 406, the private videoconference may be initiatedbetween the plural subset of the plurality of videoconference endpoints.However, the initiation (and subsequent performance) of the privatevideoconference does not end the first videoconference.

During the private videoconference, in 408, the MCU may transmitvideoconference information among the plural subset of endpoints (amongthe private participants). For example, the MCU may transmit firstvideoconference information from the first videoconference endpoint ofthe plural subset to one or more second videoconference endpoints of theplural subset to conduct the private videoconference. In someembodiments, the MCU may not encode and decode the first videoconferenceinformation.

Additionally, during the private videoconference, in 410, the MCU maytransmit videoconference information among the remaining subset ofendpoints to conduct the first (main) videoconference. In other words,the main videoconference continues for those participants who are notpart of the private videoconference. For example, the MCU may transmitsecond videoconference information from a first videoconference endpointof a remaining subset of endpoints to one or more second videoconferenceendpoints of the remaining subset to conduct the first videoconference.The MCU may encode and decode the second videoconference information.However, the first videoconference information of the plural subset (theprivate videoconference) is not transmitted to the remaining subset (themain videoconference). In one embodiment, the second videoconferenceinformation of the remaining subset (the main videoconference) is nottransmitted to the plural subset (the private videoconference). However,in alternate embodiments, the MCU may also transmit the secondvideoconference information (the content of the main videoconference) tothe plural subset (i.e., to the participants of the privatevideoconference). Thus, in this embodiment the participants of theprivate videoconference see each other as well as content of the mainvideoconference, but of course the participants of the mainvideoconference do not see the content of the private videoconference.In one embodiment, the plural subset of endpoints (the privatevideoconference participants) see the videoconferencing information ofthe main videoconference in a portion of their display, so that they canbe assured that their private videoconference is in fact private.

In some embodiments, the remaining subset of videoconferencing endpointsmay display text or a static image for at least one, and possibly all,of the plural subset of videoconferencing endpoints during the privatevideoconference. More specifically, one or more portions of the displaywhich were previously dedicated to participants which are now in theprivate videoconference may have the text or static images displayed.For example, the text “private” or a static image of the participant orparticipant location (or other image) may be displayed in thecorresponding portion of the display. In one embodiment, the text orstatic image may visually indicate which of the endpoints/participantsare participating in the private conference. In some embodiments, thisoverlay or substitution be performed by the MCU. Additionally, the MCUmay store state information to keep track of the state of each of theendpoints, e.g., pertaining to which videoconference each one is in, inorder to perform correct encoding/decoding/transmission.

FIG. 7 illustrates exemplary screen layouts for the participants ofFIGS. 5A and 5B during the private videoconference. As shown, theprivate videoconference is between Alice and Jane, which, in oneembodiment, may only see each other. However, it should be noted that inalternate embodiments, Alice and Jane may continue to see (e.g., but nothear, or at least at a lower volume) the other participants, Joe andMike. As also shown, Mike and Joe may continue the firstvideoconference, but may not see or hear Alice and Jane. Instead, in theembodiment shown, the text “private” may be displayed for thecorresponding portions for Alice and Jane on Mike and Joe's displays.Thus, during the private videoconference Alice and Jane may privatelydiscuss matters while Mike and Joe continue the first videoconference.

FIG. 8 illustrates a diagrammatic representation of one embodiment ofthe method of FIG. 4A. As shown, there is a videoconference between fourparticipants: A (organizer with MCU functionality), B, C, and D. Duringthe videoconference, participant B requests a private meeting with C andthe private meeting request is approved from participant C via the MCUat A.

The MCU at A may accept the meeting start request from Jane with Alice'saddress. The MCU may also maintain a record which sets the state of Janeand Alice as being in meeting-in-meeting. The MCU may signal to Self tonot decode the Video and Audio from B. The MCU may signal to Self toforward the Video and Audio from B endpoint to C. The MCU may signal toSelf to not decode the Video and Audio from C. The MCU may signal toSelf to forward the Video and Audio from C to B. The MCU may finallysignal to Self to insert/overlay a note or an icon on the quadrantrepresenting B and C's image in the 4-way composite image. This notecould say “Private”. Thus, the private meeting or videoconference isestablished and A/V data from participant B is sent to A and similarly,A/V data from participant C is sent to A. This A/V data is redirectedjust to C and B respectively (and not to A or D), e.g., without beingmixed, decoded, or encoded. During the private meeting, D continues inthe main conference by sending A/V data to A. Additionally, A maycontinue to generate a composite image for A and D and send thecomposite image to D. A may also display the composite image. D and Amay continue to send their audio to each other. Where there are morethan two participants remaining, the MCU may perform normal audio mixingfor the remaining participants. In some embodiments, A may continuesending A/V data to C and B corresponding to A and D, but this is notrequired. During the private videoconference, the screen layouts of theparticipants may be similar to that shown in FIG. 7.

In one embodiment, to end the private videoconference, the MCU mayaccept the meeting end request from B or C. The MCU may signal to Selfto decode and composite Video and mix Audio from C. The MCU may signalto Self to decode and composite Video and mix Audio from B. The MCU maysignal to Self to remove the note or an icon on the quadrantrepresenting B and C's image in the 4-way composite image. Thesequadrants will have the live video from B and C. The MCU may delete orupdate the record which had the state of B and C as being inmeeting-in-meeting. After ending the private videoconference, the screenlayouts of the participants may be similar to that of FIGS. 5A and 5B.

Thus, in 412, the private videoconference may be ended between theplural subset of the plurality of endpoints. Correspondingly, the pluralsubset of endpoints may be rejoined with the remaining subset in thefirst videoconference, and the first videoconference may continue withthe plurality of endpoints, and the first videoconference may beperformed normally, as in 402 above. The private videoconference may beended by one or more of the private participants, e.g., using a remoteor other input device.

FIG. 4B—Private Videoconference Using an Direct Transfer

FIG. 4B illustrates a method for performing a private videoconferencewithin a first videoconference using direct transfer. The method shownin FIG. 4 may be used in conjunction with any of the computer systems ordevices shown in the above Figures, among other devices. In variousembodiments, some of the method elements shown may be performedconcurrently, performed in a different order than shown, or omitted.Additional method elements may also be performed as desired. As shown,this method may operate as follows.

In 462, similar to 402 above, a first videoconference between aplurality of videoconference endpoints may be initially performed. Forexample, a multipoint control unit (MCU) may perform decoding andencoding operations on video information transmitted in the firstvideoconference between the plurality of videoconferencing endpoints.

In 464, similar to 404 above, input requesting the private conferencefor a plural subset of the plurality of endpoints may be received duringthe first videoconference. The plural subset may consist of a firstendpoint and one or more second endpoints, and is not the entirety ofthe plurality of endpoints. In some embodiments, the input may bereceived from a first endpoint of the first videoconference (e.g., froma user via a graphical user interface (GUI) of the first endpoint).

Correspondingly, in 466, similar to 406 above, the privatevideoconference may be initiated between the plural subset of theplurality of videoconference endpoints. However, the initiation (andsubsequent performance) of the private videoconference does not end thefirst videoconference.

During the private videoconference, in 468, first videoconferenceinformation may be transmitted from the first endpoint directly to thesecond one or more endpoints of the plural subset. As used herein, the“direct” transmission from the first videoconference endpoint to thesecond one or more endpoints during the private videoconference isdirect in the sense that it is not transmitted to or via a controllingunit (e.g., the MCU) of the first videoconference. However, thetransmission may still be direct if it is sent via one or more otherdevices, e.g., network devices, such as routers, gateways, etc. Thus,the “direct” transmission bypasses the MCU of the first videoconference.

Also during the private conference, in 470, similar to 410 above, aremaining subset of the plurality of endpoints may continue transmittingvideoconference data in the first conference. For example, the MCU maycontinue to perform decoding and encoding for the remaining subset ofthe plurality of endpoints. The videoconference data of the pluralsubset is not transmitted to the remaining subset.

In some embodiments, as indicated above, the remaining subset ofvideoconferencing endpoints may display text or a static image for atleast one of the plural subset of videoconferencing endpoints during theprivate videoconference. More specifically, one or more portions of thedisplay which were previously dedicated to participants which are now inthe private videoconference may have the text or static imagesdisplayed. For example, the text “private” or a static image of theparticipant or participant location (or other image) may be displayed inthe corresponding portion of the display.

FIG. 9 illustrates a diagrammatic representation of one embodiment ofthe method of FIG. 4B. As shown, there is a videoconference between fourparticipants: A (organizer with MCU functionality), B, C, and D. Duringthe videoconference, participant B requests a private meeting with C.The request may be received via the MCU at A or independently, asdesired.

For example, the MCU at A may accept the meeting start request from Bwith C's address. The MCU may maintain a record which sets the state ofB and C as being in a private videoconference (or meeting-in-meeting).The MCU may signal to C to redirect the video and audio to B. The MCUmay signal to B to redirect the video and audio to C. The MCU may signalto Self to insert/overlay a note or an icon on the quadrant representingB and C's image in the 4-way composite image. This note could say“Private”. The MCU may signal to Self to not send video and audio mediato B and C. Thus, the private meeting or videoconference is establishedand A/V data from participant B is sent to C without being sent to A andsimilarly, A/V data from participant C is sent to B without being sentto A. During the private meeting, D continues in the main conference bysending A/V data to A. Additionally, A may continue to generate acomposite image for A and D and send the composite image to D. A mayalso display the composite image. D and A may continue to send theiraudio to each other. Where there are more than two participantsremaining, the MCU may perform normal audio mixing for the remainingparticipants. However, note that in some embodiments, A may continuesending A/V data to C and B corresponding to A and D, but this is notrequired. During the private videoconference, the screen layouts of theparticipants may be similar to that shown in FIG. 7.

In one embodiment, to end the private videoconference, the MCU mayaccept the meeting end request from B or C. The MCU may signal to C toredirect the video and audio to A. The MCU may signal to B to redirectthe video and audio to A. The MCU may signal to Self to remove the noteor an icon on the quadrant representing B and C's image in the 4-waycomposite image. These quadrants will have the live video from B and C.The MCU may signal to Self to send video and audio media to B and C.Finally, the MCU may delete the record which had the state of B and C asbeing in a private meeting. After ending the private videoconference,the screen layouts of the participants may be similar to that of FIGS.5A and 5B.

Thus, in 472, similar to 412, the private videoconference may be endedbetween the plural subset of the plurality of endpoints.Correspondingly, the plural subset of endpoints may be rejoined with theremaining subset in the first videoconference, and the firstvideoconference may be performed normally, as in 402 or 452 above. Theprivate videoconference may be ended by one or more of the privateparticipants, e.g., using a remote or other input device.

Further Embodiments

In some embodiments, following any of the methods described above, theendpoints of the private videoconference may receive thevideoconferencing data of the remaining participants/endpoints. Thus, byseeing this videoconferencing data, participants of the privatevideoconference can be assured that their videoconference is trulyprivate, and are thus free to discuss matters that the other memberspotentially should not hear.

Note that in some embodiments, participants at the same participantlocation may wish to conduct a private videoconference separate fromother participants at the location. In such cases, separate computersystems or videoconferencing systems may be required to achieve thedesired functionality.

Additionally, while the above embodiments discussed the routing andencoding of video and audio data to achieve the private videoconference,in some embodiments, only the audio data may be affected. For example,during a private videoconference, the video may be displayed forparticipants of the private videoconference, but the audio data may bemuted or not transmitted to the other participants, thereby masking whatis being discussed in the private video conference. In some embodiments,the participants themselves may be able to choose between only maskingthe audio or masking both the audio and video.

Further, the participants may be able to choose from a wide variety oflayouts prior to or during the private videoconference, e.g., from theones shown in FIGS. 5A and 5B, or others. For example, the layout thatis shown to the private participants can continue to show the otherparticipants and maximize the private participant as an option.Alternatively, or additionally, for the remaining participants, thelayout can block the view of the private participants and show a messagethat these parties are having a private conversation. This choice may bean implementation specific choice or a participant level choice.

ADVANTAGES OF THE METHOD

As indicated in the background, previous methods required users toconduct private conversations using other means, such as cell phones orinstant messaging. However, using the methods described above forconducting a private videoconference, members can decide to have aconference which needs to be private (e.g., that the other members donot wish to or should not hear), they are not required to use offlinemethods or leave the videoconference entirely. Additionally, theremaining participants are not affected or intimated about the ongoingprivate videoconference and can continue the first videoconference,thereby providing a seamless flow for creating private conferences andrejoining the main conference.

Additionally, using the method of FIG. 4A, network visibility challengesare avoided that may exist between the two endpoints that are planningto have the private conversation.

Thus, the private videoconferences described above can alleviate thenecessity to have PCs in a meeting where users will have to IM eachother so as not to disturb the other participants in the meeting.Additionally, participants need not leave the current meeting in orderto have a private conversation with other participants who arephysically located at a different location.

Embodiments of a subset or all (and portions or all) of the above may beimplemented by program instructions stored in a memory medium or carriermedium and executed by a processor. A memory medium may include any ofvarious types of memory devices or storage devices. The term “memorymedium” is intended to include an installation medium, e.g., a CompactDisc Read Only Memory (CD-ROM), floppy disks, or tape device; a computersystem memory or random access memory such as Dynamic Random AccessMemory (DRAM), Double Data Rate Random Access Memory (DDR RAM), StaticRandom Access Memory (SRAM), Extended Data Out Random Access Memory (EDORAM), Rambus Random Access Memory (RAM), etc.; or a non-volatile memorysuch as a magnetic media, e.g., a hard drive, or optical storage. Thememory medium may include other types of memory as well, or combinationsthereof. In addition, the memory medium may be located in a firstcomputer in which the programs are executed, or may be located in asecond different computer that connects to the first computer over anetwork, such as the Internet. In the latter instance, the secondcomputer may provide program instructions to the first computer forexecution. The term “memory medium” may include two or more memorymediums that may reside in different locations, e.g., in differentcomputers that are connected over a network.

In some embodiments, a computer system at a respective participantlocation may include a memory medium(s) on which one or more computerprograms or software components according to one embodiment of thepresent invention may be stored. For example, the memory medium maystore one or more programs that are executable to perform the methodsdescribed herein. The memory medium may also store operating systemsoftware, as well as other software for operation of the computersystem.

Further modifications and alternative embodiments of various aspects ofthe invention may be apparent to those skilled in the art in view ofthis description. Accordingly, this description is to be construed asillustrative only and is for the purpose of teaching those skilled inthe art the general manner of carrying out the invention. It is to beunderstood that the forms of the invention shown and described hereinare to be taken as embodiments. Elements and materials may besubstituted for those illustrated and described herein, parts andprocesses may be reversed, and certain features of the invention may beutilized independently, all as would be apparent to one skilled in theart after having the benefit of this description of the invention.Changes may be made in the elements described herein without departingfrom the spirit and scope of the invention as described in the followingclaims.

What is claimed is:
 1. A method for conducting a private videoconferencewithin a first videoconference, comprising: performing, by a multipointcontrol unit (MCU), the first videoconference between a plurality ofvideoconference endpoints, wherein the MCU performs decoding andencoding operations on video information transmitted in the firstvideoconference; receiving input requesting the private videoconferencefor a plural subset of the plurality of videoconference endpoints,wherein the plural subset is not the entirety of the plurality ofvideoconference endpoints, and wherein the input is received during thefirst videoconference; initiating the private videoconference betweenthe plural subset of the plurality of videoconference endpoints, whereinsaid initiating the private videoconference does not end the firstvideoconference; wherein during the private videoconference:transmitting, by the MCU, first videoconference information from a firstvideoconference endpoint of the plural subset to one or more secondvideoconference endpoints of the plural subset to conduct the privatevideoconference, wherein the MCU does not encode, decode, nor generate acomposite image using the first videoconference information; andtransmitting, by the MCU, second videoconference information from afirst videoconference endpoint of a remaining subset to one or moresecond videoconference endpoints of the remaining subset to conduct thefirst videoconference, wherein the MCU encodes and decodes the secondvideoconference information; wherein the first videoconferenceinformation of the plural subset is not transmitted to the remainingsubset.
 2. The method of claim 1, wherein the second videoconferenceinformation of the remaining subset is not transmitted to the pluralsubset.
 3. The method of claim 1, further comprising: transmitting, bythe MCU, the second videoconference information of the remaining subsetto the plural subset.
 4. The method of claim 1, wherein the input isreceived from the first endpoint of the plural subset.
 5. The method ofclaim 1, wherein the input is received via a graphical user interface ofone of the plural subset of videoconferencing endpoints.
 6. The methodof claim 1, further comprising: ending the private videoconferencebetween the plural subset of the plurality of endpoints, wherein saidending comprises rejoining the plural subset with the remaining subsetin the first videoconference.
 7. The method of claim 1, wherein theremaining subset of videoconferencing endpoints display text or a staticimage for at least one of the plural subset of videoconferencingendpoints during the private videoconference.
 8. A non-transitorycomputer accessible memory medium storing program instructions forconducting a private videoconference within a first videoconference,wherein the program instructions are executable to: perform the firstvideoconference between a plurality of videoconference endpoints,wherein said performing comprises decoding and encoding operations onvideo information transmitted in the first videoconference; receiveinput requesting the private videoconference for a plural subset of theplurality of videoconference endpoints, wherein the plural subset is notthe entirety of the plurality of videoconference endpoints, and whereinthe input is received during the first videoconference; initiate theprivate videoconference between the plural subset of the plurality ofvideoconference endpoints, wherein said initiating the privatevideoconference does not end the first videoconference; wherein duringthe private videoconference: transmit first videoconference informationfrom a first videoconference endpoint of the plural subset to one ormore second videoconference endpoints of the plural subset to conductthe private videoconference, wherein the MCU does not encode, decode,nor generate a composite image using the first videoconferenceinformation; and transmit second videoconference information from afirst videoconference endpoint of a remaining subset to one or moresecond videoconference endpoints of the remaining subset to conduct thefirst videoconference, wherein the MCU encodes and decodes the secondvideoconference information; wherein the first videoconferenceinformation of the plural subset is not transmitted to the remainingsubset.
 9. The non-transitory computer accessible memory medium of claim8, wherein the second videoconference information of the remainingsubset is not transmitted to the plural subset.
 10. The non-transitorycomputer accessible memory medium of claim 8, wherein the programinstructions are further executable to: transmit the secondvideoconference information of the remaining subset to the pluralsubset.
 11. The non-transitory computer accessible memory medium ofclaim 8, wherein the input is received from the first endpoint of theplural subset.
 12. The non-transitory computer accessible memory mediumof claim 8, wherein the input is received via a graphical user interfaceof one of the plural subset of videoconferencing endpoints.
 13. Thenon-transitory computer accessible memory medium of claim 8, wherein theprogram instructions are further executable to: end the privatevideoconference between the plural subset of the plurality of endpoints,wherein said ending comprises rejoining the plural subset with theremaining subset in the first videoconference.
 14. The non-transitorycomputer accessible memory medium of claim 8, wherein the remainingsubset of videoconferencing endpoints display text or a static image forat least one of the plural subset of videoconferencing endpoints duringthe private videoconference.
 15. A system for conducting a privatevideoconference within a first videoconference, comprising: a processor;a network port coupled to the processor, wherein the network port isconfigured to couple to a plurality of videoconferencing endpoints; anda memory medium coupled to the processor, wherein the memory mediumstores program instructions executable by the processor to: perform thefirst videoconference between a plurality of videoconference endpointsvia the network port, wherein the MCU performs decoding and encodingoperations on video information transmitted in the firstvideoconference; receive input requesting the private videoconferencefor a plural subset of the plurality of videoconference endpoints,wherein the plural subset is not the entirety of the plurality ofvideoconference endpoints, and wherein the input is received during thefirst videoconference; initiate the private videoconference between theplural subset of the plurality of videoconference endpoints, whereinsaid initiating the private videoconference does not end the firstvideoconference; wherein during the private videoconference: transmit,via the network port, first videoconference information from a firstvideoconference endpoint of the plural subset to one or more secondvideoconference endpoints of the plural subset to conduct the privatevideoconference, wherein the MCU does not encode, decode, nor generate acomposite image using the first videoconference information; andtransmit, via the network port, second videoconference information froma first videoconference endpoint of a remaining subset to one or moresecond videoconference endpoints of the remaining subset to conduct thefirst videoconference, wherein the MCU encodes and decodes the secondvideoconference information; wherein the first videoconferenceinformation of the plural subset is not transmitted to the remainingsubset.
 16. The system of claim 15, wherein the second videoconferenceinformation of the remaining subset is not transmitted to the pluralsubset.
 17. The system of claim 15, wherein the program instructions arefurther executable to: transmit the second videoconference informationof the remaining subset to the plural subset.
 18. The system of claim15, wherein the input is received from the first endpoint of the pluralsubset.
 19. The system of claim 15, wherein the program instructions arefurther executable to: end the private videoconference between theplural subset of the plurality of endpoints, wherein said endingcomprises rejoining the plural subset with the remaining subset in thefirst videoconference.
 20. The system of claim 15, wherein the remainingsubset of videoconferencing endpoints display text or a static image forat least one of the plural subset of videoconferencing endpoints duringthe private videoconference.